Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add missing Jenkins stages for Auditbeat #18835

Merged
merged 6 commits into from
May 30, 2020

Conversation

jsoriano
Copy link
Member

@jsoriano jsoriano commented May 28, 2020

Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.

Parallelize all Auditbeat stages.

Skip tests in auditbeat that are currently failing, issue to follow up created: #18855

Part of #17411

@jsoriano jsoriano self-assigned this May 28, 2020
@botelastic botelastic bot added needs_team Indicates that the issue/PR needs a Team:* label Team:Automation Label for the Observability productivity team and removed needs_team Indicates that the issue/PR needs a Team:* label labels May 28, 2020
@elasticmachine
Copy link
Collaborator

elasticmachine commented May 28, 2020

💔 Build Failed

Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: [Pull request #18835 updated]

  • Start Time: 2020-05-29T14:52:00.066+0000

  • Duration: 86 min 41 sec

Test stats 🧪

Test Results
Failed 0
Passed 8829
Skipped 1467
Total 10296

Steps errors

Expand to view the steps failures

  • Name: Install Go 1.13.10

    • Description: .ci/scripts/install-go.sh

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-29T15:14:26.761+0000

    • log

  • Name: Mage build test

    • Description: mage build test

    • Duration: 10 min 46 sec

    • Start Time: 2020-05-29T15:26:55.899+0000

    • log

  • Name: Install Go 1.13.10

    • Description: .ci/scripts/install-go.sh

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-29T15:14:36.076+0000

    • log

  • Name: Install Go 1.13.10

    • Description: .ci/scripts/install-go.sh

    • Duration: 1 min 57 sec

    • Start Time: 2020-05-29T15:14:40.517+0000

    • log

  • Name: Make -C generator/_templates/metricbeat test

    • Description: make -C generator/_templates/metricbeat test

    • Duration: 6 min 33 sec

    • Start Time: 2020-05-29T15:53:36.223+0000

    • log

  • Name: Make -C generator/_templates/beat test

    • Description: make -C generator/_templates/beat test

    • Duration: 6 min 1 sec

    • Start Time: 2020-05-29T16:06:55.206+0000

    • log

Log output

Expand to view the last 100 lines of log output

[2020-05-29T16:13:16.062Z]   OS/Arch:      linux/amd64
[2020-05-29T16:13:16.062Z]   Experimental: false
[2020-05-29T16:13:16.062Z]  containerd:
[2020-05-29T16:13:16.062Z]   Version:     v1.2.10
[2020-05-29T16:13:16.062Z]   GitCommit:                  b34a5c8af56e510852c35414db4c1f4fa6172339
[2020-05-29T16:13:16.062Z]  runc:
[2020-05-29T16:13:16.062Z]   Version:     1.0.0-rc8+dev
[2020-05-29T16:13:16.062Z]   GitCommit:                  3e425f80a8c931f88e6d94a8c831b9d5aa481657
[2020-05-29T16:13:16.062Z]  docker-init:
[2020-05-29T16:13:16.062Z]   Version:     0.18.0
[2020-05-29T16:13:16.062Z]   GitCommit:                  fec3683
[2020-05-29T16:17:14.854Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats
[2020-05-29T16:17:15.160Z] + find . -type f -name TEST*.xml -path */build/* -delete
[2020-05-29T16:17:15.172Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Lint
[2020-05-29T16:17:15.248Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Winlogbeat-oss
[2020-05-29T16:17:15.320Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Elastic-Agent-x-pack
[2020-05-29T16:17:15.400Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Dockerlogbeat
[2020-05-29T16:17:15.471Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-crosscompile
[2020-05-29T16:17:15.540Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Journalbeat-oss
[2020-05-29T16:17:15.610Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Metricbeat-Linux
[2020-05-29T16:17:15.688Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-OSS-Integration-tests
[2020-05-29T16:17:15.759Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Functionbeat-x-pack
[2020-05-29T16:17:15.830Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Elastic-Agent-Mac-OS-X
[2020-05-29T16:17:15.899Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Elastic-Agent-x-pack-Windows
[2020-05-29T16:17:15.970Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-crosscompile
[2020-05-29T16:17:16.044Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-OSS-Unit-tests
[2020-05-29T16:17:16.129Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Heartbeat-oss
[2020-05-29T16:17:16.201Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-x-pack-Mac-OS-X
[2020-05-29T16:17:16.272Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-x-pack-Mac-OS-X
[2020-05-29T16:17:16.342Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-x-pack-Windows
[2020-05-29T16:17:16.418Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-x-pack
[2020-05-29T16:17:16.489Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-oss-Windows
[2020-05-29T16:17:16.558Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-x-pack
[2020-05-29T16:17:16.629Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Packetbeat-oss
[2020-05-29T16:17:16.698Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Winlogbeat-Windows-x-pack
[2020-05-29T16:17:16.773Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-oss-Mac-OS-X
[2020-05-29T16:17:16.843Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-Mac-OS-X
[2020-05-29T16:17:16.911Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-Windows
[2020-05-29T16:17:16.979Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-Mac-OS-X
[2020-05-29T16:17:17.049Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-x-pack-Mac-OS-X
[2020-05-29T16:17:17.118Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-x-pack-Windows
[2020-05-29T16:17:17.188Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Auditbeat-oss-Linux
[2020-05-29T16:17:17.265Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-Windows
[2020-05-29T16:17:17.337Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Winlogbeat-Windows
[2020-05-29T16:17:17.408Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-x-pack-Windows
[2020-05-29T16:17:17.479Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Heartbeat-Mac-OS-X
[2020-05-29T16:17:17.549Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Functionbeat-Mac-OS-X-x-pack
[2020-05-29T16:17:17.619Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Beat-Linux
[2020-05-29T16:17:17.690Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-x-pack
[2020-05-29T16:17:17.762Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-x-pack
[2020-05-29T16:17:17.834Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Filebeat-oss
[2020-05-29T16:17:17.905Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Heartbeat-Windows
[2020-05-29T16:17:17.976Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Metricbeat-Python-integration-tests
[2020-05-29T16:17:18.047Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-oss
[2020-05-29T16:17:18.116Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Functionbeat-Windows
[2020-05-29T16:17:18.186Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-crosscompile
[2020-05-29T16:17:18.258Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Libbeat-stress-tests
[2020-05-29T16:17:18.342Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Metricbeat-Mac-OS-X
[2020-05-29T16:17:18.414Z] Running in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats/Generators-Beat-Mac-OS-X
[2020-05-29T16:17:18.764Z] + cat
[2020-05-29T16:17:18.764Z] + /usr/local/bin/runbld ./runbld-script
[2020-05-29T16:17:18.764Z] Picked up JAVA_TOOL_OPTIONS: -Dfile.encoding=UTF8
[2020-05-29T16:17:25.355Z] runbld>>> runbld started
[2020-05-29T16:17:25.355Z] runbld>>> 1.6.11/a66728ff8f4356963772e6e6d2069392fa06acbe
[2020-05-29T16:17:26.739Z] runbld>>> The following profiles matched the job 'Beats/beats-beats-mbp/PR-18835' in order of occurrence in the config (last value wins).
[2020-05-29T16:17:28.124Z] runbld>>> Debug logging enabled.
[2020-05-29T16:17:28.124Z] runbld>>> Storing result
[2020-05-29T16:17:28.124Z] runbld>>> Store result: created {:total 2, :successful 2, :failed 0} 1
[2020-05-29T16:17:28.124Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200529161727-1ABD4DB2
[2020-05-29T16:17:28.124Z] runbld>>> Adding system facts.
[2020-05-29T16:17:29.067Z] runbld>>> Adding vcs info for the latest commit:  da75568821ae55be2d1076f4ef6eb417ece61d2d
[2020-05-29T16:17:29.068Z] runbld>>> >>>>>>>>>>>> SCRIPT EXECUTION BEGIN >>>>>>>>>>>>
[2020-05-29T16:17:29.068Z] runbld>>> Adding /usr/lib/jvm/java-8-openjdk-amd64/bin to the path.
[2020-05-29T16:17:29.068Z] Processing JUnit reports with runbld...
[2020-05-29T16:17:29.068Z] + echo 'Processing JUnit reports with runbld...'
[2020-05-29T16:17:29.639Z] runbld>>> <<<<<<<<<<<< SCRIPT EXECUTION END <<<<<<<<<<<<
[2020-05-29T16:17:29.639Z] runbld>>> DURATION: 13ms
[2020-05-29T16:17:29.639Z] runbld>>> STDOUT: 40 bytes
[2020-05-29T16:17:29.639Z] runbld>>> STDERR: 49 bytes
[2020-05-29T16:17:29.639Z] runbld>>> WRAPPED PROCESS: SUCCESS (0)
[2020-05-29T16:17:29.639Z] runbld>>> Searching for build metadata in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats
[2020-05-29T16:17:31.024Z] runbld>>> Storing build metadata: 
[2020-05-29T16:17:31.024Z] runbld>>> Adding test report.
[2020-05-29T16:17:31.024Z] runbld>>> Searching for junit test output files with the pattern: TEST-.*\.xml$ in: /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835/src/github.com/elastic/beats
[2020-05-29T16:17:31.967Z] runbld>>> Found 56 test output files
[2020-05-29T16:17:33.881Z] runbld>>> Test output logs contained: Errors: 0 Failures: 0 Tests: 10146 Skipped: 1335
[2020-05-29T16:17:34.141Z] runbld>>> Storing result
[2020-05-29T16:17:34.141Z] runbld>>> FAILURES: 0
[2020-05-29T16:17:34.403Z] runbld>>> Store result: updated {:total 2, :successful 2, :failed 0} 2
[2020-05-29T16:17:34.403Z] runbld>>> BUILD: https://c150076387b5421f9154dfbf536e5c60.us-west1.gcp.cloud.es.io:9243/build-1587637540455/t/20200529161727-1ABD4DB2
[2020-05-29T16:17:34.403Z] runbld>>> Email notification disabled by environment variable.
[2020-05-29T16:17:34.403Z] runbld>>> Slack notification disabled by environment variable.
[2020-05-29T16:17:39.980Z] Running on Jenkins in /var/lib/jenkins/workspace/Beats_beats-beats-mbp_PR-18835
[2020-05-29T16:17:40.108Z] [INFO] getVaultSecret: Getting secrets
[2020-05-29T16:17:40.166Z] Masking supported pattern matches of $VAULT_ADDR or $VAULT_ROLE_ID or $VAULT_SECRET_ID
[2020-05-29T16:17:40.928Z] + chmod 755 generate-build-data.sh
[2020-05-29T16:17:40.928Z] + ./generate-build-data.sh https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/ https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7 FAILURE 5140602
[2020-05-29T16:17:40.928Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7/steps/?limit=10000 -o steps-info.json
[2020-05-29T16:17:42.811Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7/tests/?status=FAILED -o tests-errors.json
[2020-05-29T16:17:43.722Z] INFO: curl https://beats-ci.elastic.co/blue/rest/organizations/jenkins/pipelines/Beats/beats-beats-mbp/PR-18835/runs/7/log/ -o pipeline-log.txt

@jsoriano jsoriano force-pushed the jenkinsfile-auditbeat branch from 36838d8 to 5f8faf6 Compare May 29, 2020 10:29
@jsoriano jsoriano marked this pull request as ready for review May 29, 2020 14:53
@jsoriano jsoriano requested a review from a team as a code owner May 29, 2020 14:53
@jsoriano
Copy link
Member Author

Failure in Metricbeat x-pack should be solved by #18777

@jsoriano jsoriano added the needs_backport PR is waiting to be backported to other branches. label May 29, 2020
@jsoriano jsoriano merged commit 3bf5689 into elastic:master May 30, 2020
@jsoriano jsoriano deleted the jenkinsfile-auditbeat branch May 30, 2020 10:39
jsoriano added a commit to jsoriano/beats that referenced this pull request May 30, 2020
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.

(cherry picked from commit 3bf5689)
@jsoriano jsoriano added v7.9.0 and removed needs_backport PR is waiting to be backported to other branches. labels May 30, 2020
jsoriano added a commit that referenced this pull request May 30, 2020
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.

(cherry picked from commit 3bf5689)
v1v added a commit to v1v/beats that referenced this pull request Jun 2, 2020
…-stage-level

* upstream/master: (30 commits)
  Add a GRPC listener service for Agent (elastic#18827)
  Disable host.* fields by default for iptables module (elastic#18756)
  [WIP] Clarify capabilities of the Filebeat auditd module (elastic#17068)
  fix: rename file and remove extra separator (elastic#18881)
  ci: enable JJBB (elastic#18812)
  Disable host.* fields by default for Checkpoint module (elastic#18754)
  Disable host.* fields by default for Cisco module (elastic#18753)
  Update latest.yml testing env to 7.7.0 (elastic#18535)
  Upgrade k8s.io/client-go and k8s keystore tests (elastic#18817)
  Add missing Jenkins stages for Auditbeat (elastic#18835)
  [Elastic Log Driver] Create a config shim between libbeat and the user (elastic#18605)
  Use indexers and matchers in config when defaults are enabled (elastic#18818)
  Fix panic on `metricbeat test modules` (elastic#18797)
  [CI] Fix permissions in MacOSX agents (elastic#18847)
  [Ingest Manager] When not port are specified and the https is used fallback to 443 (elastic#18844)
  [Ingest Manager] Fix install service script for windows (elastic#18814)
  [Metricbeat] Fix getting compute instance metadata with partial zone/region config (elastic#18757)
  Improve error messages in s3 input (elastic#18824)
  Add memory metrics into compute googlecloud (elastic#18802)
  include bucket name when logging error (elastic#18679)
  ...
@v1v v1v mentioned this pull request Jun 3, 2020
2 tasks
v1v pushed a commit to v1v/beats that referenced this pull request Jun 12, 2020
Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.
v1v added a commit that referenced this pull request Jun 12, 2020
…19151)

Runs unit tests of Auditbeat x-pack in Windows and Mac OS X.
Parallelize all Auditbeat stages.
Skip tests in Auditbeat that are currently failing.

Co-authored-by: Jaime Soriano Pastor <jaime.soriano@elastic.co>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Team:Automation Label for the Observability productivity team v7.9.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants